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As the spectral tristimulus values of the CIE Standard Observer System for Colorimetry 
are measurable quantities, their variabilities should be known. This paper describes a pro- 
cedure for deriving "within" and "between" variances and covariances in the spectral 
tristimulus values, based on color-matching data for individual observers. The "within" 
variances are based on the replications of color-mixture data by an observer. The "between" 
variances are based on differences among the color-mixture data of individual observers. A 
statistical model is given for the system in which the experimental data are obtained. For- 
mulas for expected values (means), variances, and covariances are developed. Variances 
and covariances belonging to different sources of uncertainties in the experimental data 
are considered. A procedure is developed for determining the uncertainties in the constants 
of a linear transformation to a system analogous to the present CIE system. The formulas 
for variances and covariances after linear transformation are given, for a rigorous empir- 
ically-based choice, and also for an arbitrary choice of transformation constants. The 
complete standard observer system for every 10 mp consisting of means, variances, and 
covariances derived from an arbitrary transformation, is listed. The between-observer 
variabilities are found to be about 10 percent of the averages of the color-mixture data and the 
average ratio of the between-observer variabilities to the within-observer variabilities is found 
to be about 5.7. 



1. Introduction 

Since 1931 the International Commission on 
Illumination has recommended the use of a Standard 
Observer System for Colorimetry [l]. 1 This system 
defines the manner in which spectral data for 
materials are to be reduced to three numbers, called 
tristimulus values, that describe colors of emitted, 
reflected, or transmitted lights. The defining equa- 
tions for these tristimulus values are: 

X^ J°° 5 x M?WX=So"«xiVx2xAx 

7 ~So ^ N ^ dX -^oy^T x A x 



■-j; 



zxNxT x d\=^2^N x T x A x 



The quantities x\, y\, and z\ are called spectral 
tristimulus values and are intended to be descriptive 
of the spectral-light response of the average human 
observer with normal color vision. The quantity 
N\ describes the spectral emittance of light sources 
and the quantity T\ describes the spectral character 
of the reflecting or transmitting materials. 

Tristimulus values are usually reduced to chro- 
maticity coordinates by the equations: 

x=X/S, y=Y/S, and z=Z/S, 

where S is the sum of the tristimulus values X, F, 
and Z. As x\, y\, ix, JVx, and 7\ are measured 



1 Figures in brackets indicate the literature references at the end of this paper . 



quantities, they are subject to measurement un- 
certainty. Nimeroff [2,3] has treated, by means of 
propagation of error theory, the manner in which 
variabilities in T\ and in N\ affect the chroma ticity 
coordinates, x, y, and z. 

The general problem and several special cases 
of propagation of errors in tristimulus colorimetry 
have been treated by Nimeroff [3]. In thatjxeat- 
ment the mean spectral tristimulus values, x, y, and 
z, were estimated by averaging the mean CIE (17 
observers) and mean Stiles' 2°- and 10°-fie]d pilot 
data (10 observers each). The variances in these 
values were estimated in the usual manner by using 
deviations of these three mean data from the esti- 
mated overall mean values; the covariances were 
ignored. The variances as well as the covariances 
should, however, be more fundamentally estimated; 
that is, they should be estimated from differences 
among color-mixture functions of individual observ- 
ers. Such data became available in 1959. This 
paper describes how this fundamental estimation 
of the between-observer variances and covariances 
may be made for the 10°-field color-mixture data 
of the 53 observers of Stiles-Burch [4] and the 27 
observers of Speranskaya [5], and gives estimates 
of the average within-observer variances and co- 
variances of two observers, one with 4 and the other 
with 5 replications. The estimates of covariances 
are developed on the basis of the data of the 53 
observers of Stiles-Burch. 

2. Statistical Model 

Fundamental color-matching data are obtained on 
a device where an observer is presented two fields 
which he is asked to color-match, by adjusting the 
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amounts of three primary colors. In one field, there 
is a fixed amount, E\, of a given spectral color of 
wavelength X. The three adjustable primaries hav- 
ing wavelengths 645.2, 526.3, and 444.4 m/x may be 
denoted R, G, B, respectively. One is added to the 
field containing the given color, and the other two 
are mixed in the second field. If R\ is the amount 
of the Red (R) primary (in energy units) used in 
matching E\, and G\ and B\ are similarly defined, 
then the condition of color-matching may be ex- 
pressed: 

E^R^+Gx+B h (1) 

where the primary which was mixed with the given 
color is represented by a negative quantity on the 
right-hand side of this symbolic equation. 

The complete set of color-mixture data for a single 
observer consists of the amounts of the three pri- 
maries used in matching a series of spectrum colors 
sampling the entire visible portion. These data are 
adjusted so that, in suitable units, (i?x, G\, B\) repre- 
sent the amounts used in matching a unit amount 
(energy) of the spectrum color at wavelength X. 

The empirical results for the ^tli observer may be 
denoted (R\ t , G\i, Bu). Omitting the subscript X we 
consider the following model: 



Ri = R + b Ri + e Ri 
Gi = G+b Gi + e Gi 
B i = B + b Bi +e Bi} 



(2) 



where each of R tf G u B t is represented as the sum of 
three terms: R, the average amount which would be 
used in color-matching in a population of observers 
with normal color vision; the "bias" b Ri of the ith 
observer; and an "error" e Ri . The bias b Ri is the 
amount by which the ith observer's "true" average 
differs from the population average R. The error 
€ Ri is the difference between a given observation R t 
and the ith observer's true average which is (R-j-b Ri ). 
The terms of the second and third eqs of (2) are 
similarly defined. The expected value (true average) 
of error €* is assumed to be zero; thus, for the ith 
observer, 

EAR^R+b^ 

Et[Gt]=G+bei 

EJLB^B+bBt 

where E t denotes the operation of averaging (taking 
the expected value) over the hypothetical set of re- 
peated observations by the ith observer. 

The "within" variance for the ith observer (for 
the red primarv, say) is the average squared deviation 
of R t from #,[#,], * 

V i (R i )=E i [R i -E i [R i ]] 2 =E i [e* Ri }. 

If all observers have the same "within" variance, 
then this common variance is denoted by w a%; when 
it is desired to specify the dependence of this vari- 
ance on the wavelength of the spectrum color being 
matched, the subscript X is restored and the within 
variance is denoted by w (t r \. 



Now, referring again to eq(2), the average or 
expected value of R t over the whole population of 
observers is R; E[R t ]=R, where E (without sub- 
script i) denotes the operation of averaging over 
the population of observers. Therefore, it follows 
that E[b Ri ] = 0. 

The "between" variance, in the population of 
observers, is the average squared deviation of the 
ith observer's average (R-\-b Ri ) from the population 
average R, 

b a 2 R =E[b Ri ]. 

It is assumed that the error e Ri is statistically 
independent of the observer bias b Ri . Thus, the 
total variance c| of the observed value R t for one 
observation by one observer is the sum of the 
within and between variances, and similarly for the 
green and blue primaries: 



2 2 | 2 

CF R~l) (J R~rwVR 

2 o i^ 2 

2 2 I 2 



(3) 



Although it is perhaps reasonable to assume that 
an observer's "errors" are not correlated with his 
"biases", the analyses of empirical data below will 
show that it cannot be assumed that the three 
observations R t , G t , B { for the ith observer are 
independent. Accordingly, it is necessary to know 
the co variances. The "between" covariances are: 

E[b Ri b Gi ], E[b Ri b m ], E[b Gi b Bi ]. 

The "within" covariances are: 

C i (R i ,G i )=E i [(Ri-E i [R i ])(G-E i [G i ])]=E i [e Ri e Gi }. 

4 
When we assume that the within covariances are 
equal for all observers, we may then write the total 
covariances as: 

C(R ,67) = b^RG^w^RG, 

C(R,B) = b v RB + w a RB , (4) 

C(G,B) = bdGB^T U&GB, 

where, for example, 

t><r RG =E[b Ri b Gi ] 

w ( FRG—&'i\.*Ri£Gi\* 



and 



No attempt will be made in this paper to estimate 
the within and between covariances separately; 
estimates are given for the total correlations such 
as p RG , defined by eqs (3), (4), and 



C(R,G) = p RG <T R a G 



(5) 
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The total variances and covariances are estimated 
in the usual way. For example, the estimate for 
<r% is 

f=l 

where n is the number of observers and R is the 
average of the R t for the n observers. 

3. Rigorous Transformation to a System 
Analogous to CIE 

Spectral tristimulus values, r, g, b, have been de- 
rived from measured color-matching data of the 
primaries, wavelengths 645.2, 526.3, and 444.4 ni/x. 
An empirically-based system of spectral tristimulus 
values, x, y, z, analogous to the present CIE system, 
may be derived from these tristimulus values, 
r, g, b, by means of the eqs (6) below. If we wish to 
locate the chromaticity coordinates of the equal- 
energy point (x n , y n , z n ) at the point (1/3, 1/3, 1/3) 
we must set a restriction that 'Ex\=2y\=2z\. 
This is the purpose of the adjustment factors, f Xj f y , 
and / z , respectively. 



xx=J x (k 1 7\+k 2 g\+hb\)=f x x^ 
y\=Mk 4 r x +hgx+k 6 h) =f y y' x 
~z\=fz(k 7 T\+k s gx+k 9 bx) =fz~z'\. 



(6) 



We may impose two additional restrictions on the 
system: 

1. That the tristimulus values be not less than 
zero. 

2. That no one of the functions, x, y, z, be equiv- 
alent to a linear combination of the other two. 
This restriction is established if the determinant of 
coefficients k t does not vanish, that is, 
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h 


h 


h 


h 


k§ 



5*0. 



(6a) 



If all the luminosity, Vx, is placed in the y\ pri- 
mary, and if j y is set equal to 1, then k u k 5y and k 6 
are determined by 

V\=yx=L r r\+L g g\+L b b\=k i rx+k 5 g\+kf i h (7) 

thereby making k A = L T < h = L g , andk 6 =L b . The sym- 
bols L T , L g , and L b are the luminous units of the r g J 

system. 

The solutions for the A%'s in the x and z spectral 
tristimulus functions are not obtained as directly as 
those for the AVs in the y function. Equations (8) to 
(8e) below show how a solution of the &/s in the x 
function may be obtained. 

The x' ('(ination (eq 8) contains three kiS to be de- 
termined. A unique solution for k h k 2 , and k 3 requires 
three simultaneous equations. By assigning, tenta- 
tively, a value of unity to k { (eq 8a), no loss of gen- 



erality is encountered that cannot be accounted for 
by the adjustment factor, f x , in eq (6). 



x' x =kir\+k 2 g\+k 3 b\ 
x'\ = r\+k 2 g\+kj)x. 



(8) 
(8a) 



When this is done, only two simultaneous equations 
are required to solve for the remaining two constants. 
The equations arc set up by selecting, at two wave- 
lengths (X! and A 2 ), numerical values for say, x x and 
x 2 , that will satisfy the requirement that all the tri- 
stimulus values be positive. Equation (8a) then 
becomes 

x[=r 1 +k 2 gi+k z l 1 (8b) 

x 2 =r 2 +k 2 g 2 +k 3 b 2 (8c) 

and the solutions for k 2 and k z are given by: 

t2=[(5;-r 1 )62-(^-^)6i]/(^2-^i) (8d) 
& 3 =[(^2— r 2 )gi— (x[ — ri)g 2 ]/Qib 2 — SfcW- (8e) 

The constants ki of the z function are solved in a 
similar manner as shown by eqs (9) to (9e): 



Zx=k 7 rx+k B gx+hbx 

Zx=k>jr\+ksgx+bx 

z^hh+ksfa+h 

24 = *7^4 + *8?4 + 64 



(9) 
(9a) 
(9b) 
(9c) 



k 7 =[(zz— b z )g A — (5 4 — 64)^3]/ (?304— r 4 3 ) (9d) 
h=[&— 64)^3— (ii— W^l/Cra^— ^3). (9e) 

4. Variances and Covariances in a Rigorous 
Transformation 

In general, variances and covariances based on 
propagation of error theory are: 

*-£<D'* + £(£)(©'- « 

(11) 



Gjjy- 



where U and Fare functions of (v u . . . , v k ), and 
the partial derivatives are understood to be evaluated 
at the average values of these variables. The vari 
ances of v h . . . , v k are a\ v . . . , 
denotes the covariance of v n > v m . 

As x is a function of 9 variables (r, g,_b,J'\,Jji, bu r 2 , 
92, 62), y is a function of 6 variables (r, #, ft, Zr, L g , 
Z 6 ), and 2 is a function of 9 variables (r, g, ft, r 3 , #3, 



n and *■■.-, 
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63, r 4 , gi, b±), the numbers of terms required by our 
problem can be counted readily. The numbers of 
terms in the variance equations are shown in table 1, 
and the numbers of terms in the co variance equations 
are shown in table 2 . 

Table 1. Number of terms in the variance equations 



Variables 


Variance 
terms 


Covariance 
terms 


Total 


6 
9 


6 
9 


15 
36 


21 
45 



Table 2, Number of terms in the covariance equations 



Variables 


Terms 


n 


m 


9 
9 


6 
9 


54 
81 



Thus, for every wavelength there are required in 
a rigorous transformation from rgb to xyz, 45+21 + 
45 = 11 terms for the variances and 54+81 + 54=189 
terms for the covariances, or a total of 300 terms for 
each wavelength. If the computation of the vari- 
ances and covariances is performed at every 1 m/x 
step, as the x, y, z functions have been derived by 
Judd [6], from 360 to 830 m M or at 471 wavelengths, 
some 141,300 terms would need to be computed. 

Observe further that eqs (10) and (11) would 
include covariances between observations belonging 
to different spectral colors. That is, the possible 
correlation between (for example) </ 3 and # 4 would 
be included in eq (10) and between b x and 6 3 in eq (11). 



5. Variances and Covariances in an Arbi. 
trary Transformation 

The foregoing procedure is completely general and 
rigorous for the conditions where empirical data are 
asked to indicate the choice of transformation con- 
stants, ki, for a transformation to a system analogous 
to the present CIE system. Where one wishes to 
make an arbitrary choice of transformation con- 
stants he indicates that the constants are without 
error or correlation with other variables. 

In an arbitrary transformation the variances and 
covariances involving k t are chosen equal to zero 
thus: 

V(kd = 0(k i} kj) = C(k h v t )=Q (12) 

where v t denotes any of the variables, r, g, 6, L, with 
various subscripts. Thus in the transformation, 



x\ =k l r\+k 2 g\+kj)\ 
V\=kJ : \+k 5 g\+kf i b\ 
z\ =k 7 r\+k 8 g\+k 9 bx 

the variance equations are: 

V(x) =k\V(r) +klV(g) +k!V(b) 

+2[k 1 k 2 C(r,g) +kAC(7,b) +k 2 k z C(g,b)] 
V(y) =k\V{r) +HV(g) +kW(b) 

+2[kJc b C(r,g) +hhC(r,b) +k 5 hC(g,b)] 
V{z) =Wir) +HV(g) +k 2 9 V(b) 

+2[k 7 k s C(¥,g) +k 7 k 9 C(r,b) +k 8 hC(g,b)} 



(13) 



(14) 



C(x,y)=k l hV(r) +k 2 k 5 V(g) +hk 6 V(b) + (hh+hk,) C(?,g) + (kA+hh) C(r ,6) + (k 2 h+kjc b ) CQJb) 
C(x,z) =k 1 k 7 V(¥)+k 2 k 8 V(g) +k z k 9 V{b) + {hh+hh) C(r,g) + (kJc 9 +kM (7(7,6) + (k 2 k 9 +k,k 8 ) C(g,b) 
C(y,z) =hk 7 V(r) +k 5 k s V(g) +kJc 9 V(b) + {kjc 8 +hk 7 ) C(r,g) + (hk 9 +hk 7 ) (7(7,6) + (kjc 9 +hh) C(g,b) 



(15) 



To estimate these variances and covariances from 
the data obtained in color-matching by n observers, 
the following formulas are used: 



i = \ 

£<5)=db (5«-k)V(»-i)-*S 



?'=i 



(16) 



0(r,g)=^(r t -k)(gi-k)Kn-l)=^ ri 
£(r,6)=S (7i-Mr)(b i -k)Kn-l)^ i [ (17) 



and 



n 



Vr^^ri/n, /x,=S<7fM ^l^bjn. 

»=1 i=l i=l 
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The transformation equations derived by Kelly 
and Judd [6] and being considered for recommenda- 
tion by the CIE for a L0°-field standard observer 
system for colorimetry are: 

5 10 =0.341080 7 10 +0.189145 ^o+0.387529 3 10 " 

y 10 =0.139058 7i +0.837460 ^o+0.073316 6 10 V (18; 

£ ]0 =0.000000 7 10 +0.039553 # 10 +2.026200 6 10 , . 

As the constants, k u of these equations were derived 
in a very complex way, the transformation will be 
treated as an arbitrary one. 

6. Variability of Color-Mixture Data 

The results of a statistical analysis of the Stiles- 
Burch color-matching data may be useful in deter- 
mining the variances and covariances for the trans- 
formation to the proposed new CIE standard 
observer system. The Stiles-Burch data were ana- 
lyzed because in the development of the new system 
they are being given greater weight than those of 
other investigators and because they are available in 
terms of individual observer data. Such an analysis 
was reported by Nimeroff, Rosenblatt, and Danne- 
miller [7] at the October 1959 meeting of the Optical 
Society of America and the results are given below. 

The Stiles-Burch data were obtained under two 
experimental conditions. For condition I, 24 ob- 
servers were used, while for condition II, 29 observers 
were employed. These two conditions differ in that 
the blue instrumental primary of condition I was 
located at 445.4 m/i (22,450 cm- 1 ) while that of 
condition II was located at 470.6 m/x (21,250 cm l ). 
The data taken under these two conditions were 
transformed by Stiles-and Burch to an rgb system 
system in which the blue primary is located at 
444.4 m/x. To test whether these two sets of trans- 
formed data are significantly different from each 
other the Ho telling T 2 test [8] was used. The T 2 test 
provides a comparison between _the two sets of 
averages p u representing^, g u b u of condition I 
and p 2 , representing r 2 , g 2 , b 2 , of condition II in which 
the three correlated differences between correspond- 
ing averages are evaluated simultaneously against 
the variability present in the data from which the 
averages were estimated. In this test a high value 
of T 2 implies that the differences between the aver- 
ages compared are large. The T 2 statistic in 
quadratic form for our problem of three variables in 
each of two conditions for N } and N 2 observers is: 



NN 



l\ l -\-l\ 2 ij=i 



(19) 



where S ij is the (i,j) element of the inverse of the 
three by three matrix with elements 

i r Ni 

Sij— -AT I 7y_2 >5 (Plik—Pli)(Pljk — Plj) 

n 2 n 

+S (ft*-ft«)(ft*-fti) (20) 

&=i J 



The subscripts 1 and 2 refer to the two conditions, 
i and j refer to the three primaries compared two 
at a time, and k identifies the observer for each 
condition. 

The results of this test are plotted on figure 1 
and indicate that the data obtained by Stiles under 
the two experimental conditions are in general 
statistically different even at the 2.5 percent level 
of significance, the exceptions lying between 470 
and 580m ju. The difference may result from either 
an improper evaluation of the transformations of 
the two sets of data to a common primary system 
or an inherent dependence on the choice of instru- 
mental primary. This latter supposition, if true, 
would invalidate any attempt to make the data 
obtained under the two sets of conditions comparable 
through such transformation. The differences be- 
tween conditions I and II, while statistically signifi- 
cant, are in practical terms small. 

In spite of these differences the CIE is proceeding 
to average these data as well as those of Speranskaya 
for 27 observers, to derive the 10°-field tristimulus 
functions, xyz. Figure 2 shows the averaged r 
function with its three lobes, two positive and one 
negative. Also shown are the estimates of between- 
observer standard deviations for the r function, 
based on the Stiles-Burch combined data and the 
Speranskaya data. Note that the standard devia- 
tions of these independent investigations are essen- 
tially of the same order of magnitude and range 
approximately from 10 to 20 percent of the mean 
function. 

Strictly, the estimates shown in figure 2 (likewise 
figs. 3, 4) are estimates of the total standard deviation 
(see eq (3)). As the within-observer variances are 
relatively small, the estimated between-observer 
variances are only slightly over-stated. A satis- 
factory estimate of between-observer variance alone 
can be made only when the data include repeated 
observations by many (if not all) observers. 

The lower curve gives the estimated within- 
observer standard deviations for the r function. 
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Figure 1. Values of the T 2 statistic for evaluating differences 
between Stiles' data obtained under condition I and under 
condition II. 

Critical values of T2 at three probability levels are indicated, showing that 
even at the 2.5% level the results obtained under the two conditions are for the 
most part significantly different. 
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Figure 2. Means and variability of the red-primary data. 

Means, O; standard deviations between observers (bo): Stiles A, Speranskaya 
A; standard deviations within observer Uo>). 




Figure 3. Means and varibility of the green-primary data. 



Means O; standard deviations between observers (bag): Stiles A, SperanskayaA; 
standard deviations within observer U<r,). 




Figure 4. Means and variability of the 

Means O; standard deviation between observers (b<r t ) 
A; standard deviation within observer ( w <rb). 



blue-primary data. 
Stiles A, Speranskaya 



These data are based on the average of individual 
variability of two observers, one repeating his 
measurements four times and the other repeating 
his measurements five times. As might be expected, 
the withm-observer standard deviations are ap- 
proximately an order of magnitude lower than the 
between-observer standard deviations. Note that 
because settings in matches of the primaries them- 
selves are assumed to be free from error the curves 
for the standard deviations are extended so as to 
approach zero at the location of the r~gb primaries, 
that is at wavelengths 444.4, 526.3, and 645.2 mpi. 

Figure 3 shows the same kind of information for 
the g function with its three lobes, two negative and 
one positive. Here also there is the same agreement 
between the Stiles-Burch data and the Speranskaya 
data; the within standard deviations are about an 
order of magnitude lower than the between standard 
deviations. The standard deviations approach zero 
at the location of the primaries. 

Figure 4 shows the data for the b function. Here 
there is a disparity between the Stiles-Burch and the 
Speranskaya data in the longwave region. This 
disparity may result from the transformation from 
the instrumental primaries used in the Speranskaya 
investigation to those of the rgb system. It is more 
likely, however, that the procedure used by Stiles, 
that of employing for longwave matches a yellow 
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primary at 588.2 rather than a green instrumental 
primary, is responsible for the lower variability of 
the b function in tins region. 

On figure 5 are shown averages of the between 
standard deviations derived from the data of the 53 
Stiles-Burch observers and the data of the 27 
Speranskaya observers. _ In the longwave (640 iriju and 
beyond) region of the b function the averages are 
based on the same weights used by Judd in deriving 
the mean b function itself from the British and 
Russian data. The weights for the British data are 
greater than those for the Russian data and increase 
with wavelength. 

It was noted above that the within standard 
deviations are about an order of magnitude lower 
than the between standard deviations. TVe are in- 
terested in learning whether the ratio of between to 
within standard deviations for the three functions 
can be represented by a single constant independent 
of wavelength and, if so, in determining the magni- 
tude of such a constant. The computation of within- 
observer variability in a transformation to an xyz 
system would be simplified were this permissible. 
Figure 6 shows these ratios for the three color-mix- 
ture functions. The overall average ratio was de- 
rived from the geometric mean and is 5.7 in the 
spectral region 400 to 700 m/x. The geometric mean 
was used because of the wide disparity between the 
extreme values, namely 2.0 and 30.9. We consider 
this value reasonably representative of the ratio of 
between to within standard deviations, as better 
than 80 percent of the ratios He between half and 
twice 5.7. 

In the transformations from color-mixture func- 
tions, rgb, to tristimulus values, xyz, covariances as 
well as variances need to be known. The correla- 
tion coefficient, p ih relates the covariance, <j ih to the 
variances, a], a% thus: 

On figure 7 are plotted the correlation coefficients, 
P7£P>7 T, an d pi &. In these data, a positive correla- 
tion coefficient implies that if an observer uses more 
or less than average of one instrumental primary in 
making a match he uses more or less, respectively, 
than average of the other primary, also. Conversely, 
a negative correlation coefficient implies that if more 
or less than average of one primary is used, less or 
more, respectively, than average of the other primary 
is used. We note that p-ps is always positive or zero, 
while p7i is almost always negative or zero. On the 
other hand, pii is negative in the shortwave spectral 
region, 380 to 590 m/x, and positive in the longwave 
region, 600 to 720 m/x. 

Approximately two-thirds of the correlation coeffi- 
cients are significantly different from zero at the 5 
percent level of significance. The general consistency 
of sign and magnitude among values of the correla- 
tion coefficients at adjacent wavelengths provides 
further confirmation for the general pattern of values 
shown. Although some of the correlation coeffi- 
cients are small in magnitude they should not be 




Figure 5. Mean standard deviation between observers for the 
Stiles-Burch and the Speranskaya data. 
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Figure 6. Ratio of the between to within standard deviations, 
for the three 'primaries, r (#), g(A), and b(O), showing 
overall average ratio at 5.7. 
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Figure 7. Correlation coefficients, p Xi , for ij equal to r g (O), 
fb (A),gb (•). 

Dashed lines define the region within which these coefficients are not (statis- 
tically) significantly different from zero at the 5% level. 

neglected in determining the variances and covari- 
ances in the xyz system transformed from the color- 
mixture data. 
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A few qualifications to the interpretation of the 
statistical analyses should be mentioned. First, state- 
ments concerning "statistical significance" are based 
on the assumption that the observations are normally 
distributed. 

There has been reported, however, by Judd [9] for 
7 observers and by Wyszecki [10] for 10 observers, some 
evidence that the population of observers with nor- 
mal color vision may be bimodally distributed. A 
limited analysis of the Stiles-Burch data for the 53 
observers was undertaken to see if bimodality is re- 
vealed in their individual observer data, This analy- 
sis showed (see for example fig. 8 for B 50Q against 
6?5oo) that although the distribution may be slightly 
skewed, there is insufficient data to conclude the 
existence of any bimodality. If more extensive data 
should lead to a reliable statement that the distribu- 
tion of the population is bimodal, two standard ob- 
server systems might be required, one for each group. 

A second qualification is required since possible 
correlations among observations for different spectral 
colors have been ignored because of the arbitrary 
choice of constants in the transformation. For ex- 
ample, the presence of correlation could account in 
part for the apparently consistent difference between 
conditions I and II, as shown in figure 1. 

7. Complete Standard Observer System 

A complete standard observer system should con- 
tain not only the mean spectral tristimulus functions, 
xx, y\, z\, derived from the color mixture data, but 
should contain, also, the variances and covariances 




Figure 8. Plot of R 50 o against G500 for Stiles' individual ob- 
servers indicating no bimodality and very little skewness. 
Condition I (#), condition II (O). and mean (■). Straight lines join outlying 
values obtained under the two conditions. 

of these functions as derived from the within- and 
between- observer variability of the color mixture 
data. 

Table 3 lists, for every 10 m/x, the spectral tristim- 
ulus values of the proposed standard observer sys- 
tem for colorimetry and the estimated total vari- 



Table 3. 


Proposed 


CIE tristimulus functions for 10°-fi,eld and between variances and covariances in x,y } z 


X(m/x) 


fio 


i/10 


iio 


V(x) 


V{y) 


V(z) 


C(x,y) 


C(x,z) 


C%~z) 


400 
10 
20 
30 
40 


0.0191097 
. 084736 
. 204492 
. 314679 
. 383734 


0. 0020044 
. 008756 
. 021391 
. 038676 
. 062077 


0. 0860109 

. 389366 

. 972542 

1.55348 

1.96728 


0. 000126 
. 000661 
. 000937 
. 000737 
. 000385 


0.00000118 
. 0000110 
. 0000262 
. 0000671 
. 0000448 


0. 00256 
.0132 
.0193 
.0154 
. 00978 


4-0. 0000104 
+. 0000708 
4-.0000731 
+. 000106 
+.0000816 


+0. 000568 
+. 00294 
+. 00421 
+.00329 
+.00189 


+0.0000467 
+.000321 
+. 000350 
+. 000509 
+. 000355 


450 
60 
70 
80 
90 


. 370702 
. 302273 
. 195618 
. 080507 
.016172 


. 089456 
. 128201 
. 185190 
. 253589 
. 339133 


1.99480 
1. 74537 
1.31756 
0. 772125 
. 415254 


. 000353 
. 00109 
. 00110 
. 000716 
. 000675 


. 0000561 
. 0000995 
. 000272 
. 000602 
. 00105 


.00815 
.0206 
.0180 
. 00606 
. 00234 


+.0000413 

-.0000151 

-.000101 

-.000108 

-.0000633 


+.00161 
+.00454 
+. 00423 
+.00182 
+.000973 


+.000185 
+.000136 
-.000131 
-.00000827 
+. 0000759 


500 
10 
20 
30 
40 


. 003816 
. 037465 
.117749 
. 236491 
. 376772 


. 460777 
. 606741 
.761757 
.875211 
. 961988 


. 218502 
. 112044 
. 060709 
. 030451 
. 013676 


. 000414 
. 000325 
. 000183 
. 000143 
. 000622 


.00129 
. 000829 
. 000457 
. 000253 
. 000590 


. 000593 
. 000190 
. 0000649 
. 0000271 
. 0000431 


+. 000000553 
+. 0000884 
+.000109 
+. 000100 
+. 000301 


+. 000279 
+.000112 
+.0000325 
+. 00000547 
+.0000133 


-.000245 

-.0000999 

-.0000185 

-.00000204 

-.0000285 


550 
60 
70 
80 
90 


. 529826 

. 705224 

. 878655 

1.01416 

1.11852 


.991761 
. 997340 
. 955552 
. 868934 
. 777405 


. 003988 
. 000000 


. 00143 
. 00283 
. 00437 
. 00569 
. 00588 


. 000668 
. 000847 
. 000998 
.00113 
. 000947 


. 000105 
. 000100 
. 0000942 
. 0000778 
. 0000652 


+. 000528 
+. 000960 
+. 00142 
+. 00181 
+. 00194 


+. 0000531 
+.000102 
+.000147 
+.000184 
+.000194 


-.0000700 
-.0000513 
-.0000107 
+.0000381 
+.0000806 


600 
10 
20 
30 
40 


1.12399 
1.03048 
0. 856297 
. 647467 
.431567 


. 658341 
. 527963 
. 398057 
. 283493 
.179828 




. 00493 
. 00324 
.00159 
. 000575 
. 0000750 


. 000731 
. 000475 
. 000240 
. 0000918 
. 0000127 


. 0000379 
.0000248 
. 0000123 
. 00000587 
. 000000280 


+.00170 
+. 00116 
+. 000601 
+. 000226 
+. 0000305 


+.000148 
+.000102 
+. 0000449 
+. 0000120 
+.000000138 


+.0000720 
+.0000518 
+. 0000222 
+. 00000591 
+.000000067 


650 
60 
70 
80 
90 


. 268329 
.152568 
. 0812606 
. 0408508 
. 0199413 


. 107633 
. 060281 
. 0318004 
.0159051 
. 0077488 




. 0000470 
. 0000458 
. 0000129 
. 00000427 
. 000000894 


. 00000794 
. 00000713 
. 00000192 
. 000000619 
. 000000128 


. 000000050 
. 000000043 
. 000000016 
.0000000017 
. 00000000043 


+. 0000191 
+.0000179 
+. 00000492 
+. 00000161 
+. 000000335 


+. 000000052 
+.000000166 
+. 000000084 
+ ,000000013 
+.0000000030 


+. 000000032 
+. 000000091 
+.000000044 
+.0000000077 
+.0000000016 


700 
10 
20 


. 00957688 
. 00455263 
.00217496 


.00371774 
.00176847 
. 00084619 




. 000000366 
. 000000114 
. 000000019 


. 000000052 
. 000000016 
. 0000000026 


. 00000000016 
. 000000000039 
. 0000000000043 


+. 000000137 
+. 000000042 
+. 0000000069 


+. 00000000088 
+.00000000012 
+.0000000000027 


+.00000000049 
+.000000000086 
+. 0000000000051 
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ances, V(x), V(y), V(z), and co variances, C(x,y), 
C(x,z), C{y,z), for these spectral tristimulus values 
derived on the basis of an arbitrary transformation. 
It should be noted that the variances in table 3 are 
(5.7) 2 or 32.5 times those in table 4. 

Table 4. Within variances in 5, y, z 



X 








(m/x) 


V(X) 


v(y) 


v(z) 


400 


0. 00000390 


0. 0000000364 


0. 0000788 


10 


. 0000204 


. 000000338 


. 000407 


20 


. 0000288 


. 000000806 


. 000595 


30 


. 0000227 


. 00000207 


. 000475 


40 


.0000119 


. 00000138 


. 000301 


450 


. 0000109 


. 00000173 


. 000251 


60 


. 0000337 


. 00000306 


. 000635 


70 


. 0000340 


. 00000837 


. 000556 


80 


.0000220 


. 0000185 


.000187 


90 


. 0000208 


. 0000322 


. 0000720 


500 


.0000128 


. 0000396 


. 0000183 


10 


. 0000100 


. 0000255 


. 00000587 


20 


. 00000562 


. 0000141 


. 00000200 


30 


. 00000440 


. 00000779 


. 000000834 


40 


. 0000192 


. 0000182 


. 00000133 


550 


. 0000441 


.0000206 


. 00000324 


60 


. 0000871 


. 0000261 


. 00000309 


70 


. 000135 


. 0C00307 


. 00000290 


80 


. 000172 


. 0000347 


. 00000240 


90 


. 000181 


. 0000292 


. 00000201 


COO 


. 000152 


. 0000225 


.00000117 


10 


. 0000999 


. 0000146 


. 000000764 


20 


. 0000489 


. 00000740 


. 000000380 


30 


. 0000177 


. 00000283 


. 000000181 


40 


.00000231 


. 000000391 


. 00000000862 


650 


.00000145 


. 000000245 


.00000000154 


60 


. 00000141 


. 000000220 


.00000000132 


70 


. 000000398 


. 0000000591 


.000000000493 


80 


. 000000131 


.0000000191 


. 0000000000524 


90 


. 0000000275 


. 00000000394 


. 0000000000132 


700 


.0000000113 


. 00000000160 


. 00000000000493 


10 


.00000000351 


. 000000000493 


. 00000000000120 


20 


. 000000000585 


. 0000000000801 


. 000000000000132 



8. Applications of the Complete System 

As the individual observer data, on which the 1931 
system is based, have been lost in antiquity, this 
system can be used only to determine what color 
matches the standard observer would make. A com- 
prehensive analysis of color-mixture data in terms of 
means, variances, and co variances permits use of the 
proposed system to determine, in addition, the region 



of within and between uncertainties; that is, the ex- 
tent to which a normal observer tends to make dif- 
ferent matches on successive attempts, and the extent 
to which different normal observers vary one from 
another. 

Some applications of the variances and co variances 
in the xy~z system have been reported by Nimeroff [3] 
and by Wyszecki [11]. Further applications are sure 
to be suggested when a complete standard observer 
system for colorimetry, consisting of means, vari- 
ances, and co variances, is established. 
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